reftests: Mark the currently unfixed failures as XFAIL
authorBenjamin Otte <otte@redhat.com>
Fri, 12 Apr 2019 16:01:45 +0000 (18:01 +0200)
committerBenjamin Otte <otte@redhat.com>
Fri, 12 Apr 2019 17:34:29 +0000 (19:34 +0200)
They should be fixeed before 4.0 but the fixes are more involved. And we
want to start running the existing tests on CI, because they break
regularly and we want to catch that.

testsuite/reftests/meson.build

index 93b6742dec876bd0f7a3fd3b6a302f729f36b321..e77a8579a4071284dcdbf10ad194c87f6d71991c 100644 (file)
@@ -410,6 +410,21 @@ testdata = [
   'window-show-contents-on-map.ui',
 ]
 
+# These need to be fixed but the issue hasn't been tracked down.
+xfails = [
+  'background-color-transparent.ui',
+  'background-image-multiple.ui',
+  'background-origin.ui',
+  'border-half-pixel.ui',
+  'border-image-url.ui',
+  'label-shadows.ui',
+  'label-sizing.ui',
+  'label-wrap-justify.ui',
+  'sizegroups-evolution-identity-page.ui',
+  'textview-border-windows.ui',
+  'window-show-contents-on-map.ui',
+]
+
 foreach testname : testdata
   if testname.endswith('.ui') and not testname.endswith('.ref.ui')
     test('reftest ' + testname, gtk_reftest,
@@ -424,7 +439,8 @@ foreach testname : testdata
                 'GSK_RENDERER=opengl',
                 'REFTEST_MODULE_DIR=@0@'.format(meson.current_build_dir()),
               ],
-         suite: 'reftest')
+         suite: 'reftest',
+         should_fail: xfails.contains(testname))
   endif
 endforeach